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filters (6), rank value filters (4), edge detectors (28), gain units (8) and summation 
units (10), to transform an input digitized signal (2) of an image, the transformation 
being carried out for each pixel independently. The various elements are combined 
to produce a variety of desired visual effects, e.g. a brush stroke effect, edge en- 
hancement or the appearance of a reflective chrome surface. Further, an apparatus 
is provided in which a conditioning unit generates a conditioning function, which 
enables different parts of an image to be combined in accordance with different 
methods. Thus, a foreground of an image could have the edge content reinforced, 
whilst the background has brushstroke texture added. 
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I 

5 APPARATUS AND METHOD FOR TRANSFORMING A 

DIGITIZED SIGNAL OF AN IMAGE 
Field of the Invention 

This invention relates to both method and 
apparatus for transforming pictures or images. More 
10 particularly, it relates to a method or apparatus for 
effecting a transformation of a digitized signal of an 
image to achieve a drawn , painted or other selected 
appearance . 

Background of the Invention 
15 Both colour and black and white photography are 

in widespread use for both still and moving pictures. In 
the television field at least, numerous techniques have 
been used for manipulating a television picture in various 
ways, e.g. by adding or inserting a second image into a 
20 window in a first image. However, the basic picture itself 
remains essentially unchanged. 

There is also a known technique of 
"posterisation", which essentially reduces the image to 
individual areas of solid, uniform colour, rather than 
25 progressive changes in colour. 

If one wants to achieve a hand drawn or painted 
appearance, then the principal current way of achieve this 
is to simply have a skilled artist draw or paint his 
perception of the subject in a chosen style, using 
30 conventional instruments such as pen, pencil and 
paintbrush. 

The use of an artist is acceptable in some 
circumstances, and indeed it is almost certain that a 
human artist can always add some effect or detail that can 

35 never be achieved by a machine. Nonetheless, for many 
subjects, the use of an artist is either prohibitively 
expensive or unnecessarily time consuming. In particular, 
if one wishes to add such an effect to a television 
signal, then one has the problem of applying the effect to 

40 every frame of the signal, where there are thirty frames 
per second. Clearly, for even a very short sequence, the 
amount of work involved would be prohibitive. 
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Accordingly, it is desirable to provide a 
technique which enables a conventional colour or black and 
white image to be processed to achieve a variety of 
effects, principally • giving an image a hand-drawn or 
5 painted appearance. Other more specialized effects can be 
provided, for example, an image can be rendered so that it 
appears to be a three-dimensional chrome surface. Ideally, 
one requires a method and apparatus that enables a variety 
of different techniques to be selected, manipulated and 

10 combined with one another to achieve an almost infinite 
variety of effects. It is further desirable that such an 
effect should be capable of being applied relatively 
quickly and economically to a digitized television or 
motion picture signal, or a digitized still picture or 

15 photograph. 

Summary of the Present Invention 

The present invention provides a number of 
different apparatus and methods, capable of applying a 
variety of different effects to a digitized signal of an 

20 image* These effects include t imparting a brush stroke to 
the image; strengthening the edge content of the image; 
adding ah air brush effect to the image; imparting a 
reflective chrome appearance to the image; adding 
highlights to the image; transforming the image to 

25 resemble a line drawing; and imparting a water colour 
effect to the image. 

Thus, in accordance with the present invention, 
there is provided an apparatus, for transforming a 
digitized signal of an image to give a brush stroke effect 

30 to the image, the apparatus comprising: a main input; a 
first rank value filter having an input for the original 
digitized signal, connected to the main input of the 
apparatus; a Laplacian unit having an input connected to 
an output of the rank value filter and an output; a gain 

35 unit with variable gain and connected to the output of the 
Laplacian unit; a summation unit having one input 
connected to an output of the gain unit and an output 
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forming an output of the apparatus; and a bypass line 
connected between the output of the first rank value 
filter and another input of the "summation unit. 

The present invention also encompasses an 
5 apparatus for incorporation two or more effects into a 
digitized signal of an image. The apparatus further 
includes a conditioning unit for generating a conditioning 
signal, and also an image composition unit. The image 
composition unit receives the outputs from the selected 
10 apparatus and also the output from the conditioning unit. 
The composition unit then composes an output image by 
selective combination of the outputs of the various 
apparatus , in dependence upon the conditioning signal from 
the conditioning unit. 

15 The present invention also provides methods 

corresponding to the apparatus. 
Brief Description of the Drawings 

For a better understanding of the present 
invention and to show more clearly how it may be carried 
20 into effect, reference will now be made, by way of 
example, to the accompanying drawings in which: 

Figures 1-8 show schematically a different 
apparatus as in accordance with the present invention; 

Figure 9 shows an apparatus for carrying out the 
25 conditioning process in Figure 8; and 

Figure 10 shows a schematic diagram of an 
apparatus capable of carrying out a number of different 
methods . 

Description of th e Preferred Embodiments 

30 Before describing the individual techniques in 

detail, a description of individual elements or processes 
is provided. In the following discussion, the assumption 
is made that the image is a digital image. In the case of 
an image which is initially in analog form, this would 

35 need to be processed to digitize it. Further, for the 
digitized image, this is considered to comprise a number 
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of pixels or individual points, which can be processed 
individually, as is known. 

The notion used to identify the individual 
pixels in an image is to use an x-y coordinate system, x 
5 being the horizontal coordinate . and y the vertical 
coordinate. Then, each pixel is denoted by P(x,y), where 
x and y are the coordinates for that particular pixel. P 
denotes the intensity of the pixel. Clearly, for each 
pixel, in a colour image, there will be hue and saturation 

10 parameters as well. 

There are a number of basic processes 
transformations that can be applied to the image. Thus, 
two images can be subjected to the basic arithmetic 
functions of addition, subtraction, multiplication or 

15 division, this being done on a pixel by pixel basis; eg 
each pixel of one image is added, subtracted etc. to the 
corresponding pixel of the second image, to produce a 
corresponding pixel in the final or output image. For 
example, one can simply add two images together as, by the 

20 equation P3(x,y) - P 1 (x,y) + P 2 (x,y) for all x,y. 

.. A' further technique is to simply multiply the 
intensity of each pixel by a constant gain, denoted G. 
Again, this is presented by an equations 
*z(*iY) = GP,(x,y) for all x, y. 

25 One conventional use of applying a gain to the 

pixels , is to compensate for an image which has a 
predominance of low intensity pixels, i.e. the image has 
an overall dark appearance. If one draws a histogram of 
the fre^jjuency of occurrence against intensity, one gains 

30 an. impression of the overall impression of the picture. If 
all the pixels are clustered towards the left hand end of 
the scale, i.e. indicating uniformly low intensity, then 
one can apply a certain gain to all the pixels to expand 
the range of intensity or grade levels to cover the entire 

35 range. Similarly, an excessively bright image will show a 
histogram with all the pixels clustered towards the upper 
end of the grade level or intensity scale. This can simply 
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be modified by applying a gain which, is less than unity, 
to reduce the value of the intensity. 

Image filtering is another standard technique 
which is employed, by the present invention in combination 
5 with other standard techniques* 

A mean filter or blur replaces the intensity of 
# each pixel by an intensity derived by averaging or taking 
arithmetic mean value of the intensity of that pixel and 
its neighbours. This operation is repeated for each pixel 
10 in the image. The larger the area or number of pixels 
involved in the averaging process, the greater the 
blurring effect. This is sometimes referred to as a moving 
window average, since one is effectively looking at all 
the pixels within a certain window centred on a particular 
15 pixel . 

By way of example, a 3x3 window blur would take 
the values of nine pixels in a square and then use this 
average value as the intensity for the centre pixel of 
that window. 

20 pixels at the edge of an image, as they are 

not totally surrounded by other pixels, allowance has to 
be made for this* 

There is also known in the art a large variety 
of standard filters. These filters and other techniques 
25 mentioned above have conventionally been used to enhance 
pictures suffering from noise or distortion. 
Alternatively, in the field of robotics and industrial 
applications, image processing has been used with a view 
to aiding machine or automatic recognition of objects 
30 against a background. 

In the present invention, rather than trying to 
eliminate distortion or noise, the inventors have realized 
that a variety of interesting and visually pleasing 
effects can be achieved by, in effect, deliberately 
35 introducing controlled distortion or noise. This give a 
desired visual effect in the final image. The invention 
makes use of four different digital classes, namely i 
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neighbourhood operations; point transformation operations; 
geometrical transformation; and colour space conversion. 

A neighbourhood operation is the modification of 
pixel values in a digitized image based on the value of 
5 the pixel itself and the value of nearby pixels in a pre- 
defined neighbourhood or window. By performing a 
neighbourhood transformation on every pixel on, an image, 
one can realize a number of different image filtering 
operations. Above, is given the example of simply taking 

10 the arithmetic mean to achieve a blurring effect. This is 
a particular example of a two-dimensional convolution 
(sometimes referred to as a finite impulse response 
filter)/ which simply replaces a pixel value under 
consideration with a weighted average of the pixel and its 

15 neighbours. The particular example given above took the 
same value for all the pixels in the window or 
neighbourhood, to give a low-pass filter which blurs the 
image. Different weights can be given to the pixels to 
achieve a high-pass filter which sharpens an image or a 

20 band-pass filter which enhances or suppresses certain 
details in an image. 

It should be appreciated that, for a typical 
video resolution image, there are 500 rows and 500 columns 
of pixels, giving 250,000 pixels. To take a nine-point 

25 arithmetic means for each pixel and compute in 1/30 
second, this being the time for each frame, is beyond the 
ability; of current general purpose computers. In other 
words, it is not possible to carry this out in real time 
without special purpose apparatus • 

30 An example of a Laplacian filter is given by 

equations 

P2(x,y) «4Pl(x,y)-Pl{x-l,y)-Pl(x+l,y)-Pl(x,y-l)-Pl(x,y+l) 
for all x>y 

It will be seen that if all the pixels in the 
35 neighborhood have an equal value, this results in a 
transformation giving a zero value* However, if an edge or 
high intensity image detail is located in the centre of 
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the neighbourhood/ the Laplacian operation will apply a 
high gain to this pixel value and emphasize this detail. 
The Laplacian filter overall has an effective image- 
sharpening or detail enhancement effect. 
5 In the following description of preferred 

techniques , the designation M L" in a rectangle is used to 
denote a Laplacian filter. 

Another neighbourhood operation that is commonly 
used is a rank value filter. All the pixels in the 
10 selected neighbourhood are ordered or ranked from smallest 
to largest in intensity. The centre pixel in the 
neighbourhood is then replaced with the pixel value that 
has a specified rank, A median rank filter replaces the 
centre pixel with the pixel value that represents the 
15 middle or median rank. A maximum filter replaces the 
centre pixel with the maximum value in the neighbourhood, 
and a minimum filter operates accordingly. The maximum and 
minimum rank filters fall into a special sub-class called 
morphological, which have powerful geometric properties. 

20 A maximum filter is often referred to as a dilation 
• filter, as everything expands or swells; a minimum filer 
is often referred to as an erosion filter, as everything 
shrinks. These effects are incorporated into the methods 
of the present invention to achieve a variety of effects. 

25 An interesting property of a median filter is 

that it removes or smooths details from the image that are 
smaller than the filter neighbourhood extend. It has been 
realized that this characteristic can be used to impart a 
brush-stroke impression onto an image by effectively 

30 flattening detail inside a neighbourhood. By choosing 
various neighbourhood sizes and shapes, various paintbrush 
sizes and shapes can be simulated. 

In the following discussion of preferred 
techniques or methods, the designation "RVF" is used to 

35 denote a two-dimensional rank value filter. 

Neighbourhood operations can also be used to 
implement edge detectors. An edge detector is one that 
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outputs a high value when there is a sharp change in image 
intensity and outputs a low value in areas of constant 
intensity. The output of an edge detector or edge map is 
useful for emphasizing or de-emphasizing the edge content 
5 in an image. Various techniques have been used which 
depend upon edge maps derived from edge detection. In 
other words, the filter neighbourhood size and shape 
changes based on the edge magnitude and direction. This 
enables: a variety of effects to be achieved, that are 

10 totally driven by the image content* 

In the following description of preferred 
techniques, the designation "E" is used to indicate an 
edge magnitude detector* 

It will be appreciated that for all these 

15 various filters and detectors, one can use a neighbourhood 
of a variety of sizes and shapes* The larger the 
neighbourhood, the more dramatic the change in the output 
image with respect to its input. However, the larger the 
neighbourhood, the greater the amount of computation that 

20 is required for each pixel* It is now possible to obtain 
ASICs (Application Specific Integrated Circuits) from 
several companies which will implement a convolution in 
real time with up to an 8x8 pixel neighbourhood. 

; The contrast stretch outlined above is an 

25 example of a point transformation, which involves mapping 
a single pixel value to another, independently of other 
pixel values. Another example of point operation is 
thresholding. Here, pixels that exceed a pre-defined 
intensity threshold are mapped to a particular value, and 

30 those that for below the threshold are mapped to another 
value. Shis operation can effectively be used to divide an 
iaaaga into two components, often to separate a foreground 
object from its background. The process can be generalized 
to multiple thresholds . 

35 Such thresholds can be used to effect a pseudo- 

colouring of the picture, which is carried out by 
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assigning individual colours to pre-defined intensity 
ranges . 

This point transformation operation can enhance 
perception of certain details in an image. Since point 
5 transformations amount to a simple re-mapping of a .pixel 
value , they can be realized with a look-up table (LUT) 
operation. LUT processors operating in real time are 
available from several companies. 

Another type of image transformation is one that 

10 re-maps the locations of pixels in an image. An example of 
this would be to rotate an image through a given angle. 
The present invention uses several novel geometrical image 
manipulations which are called perturbation effects, since 
location of a pixel is perturbed in some manner. By adding 

15 random noise to each pixel, one can achieve an airbrush or 
splatter paint effect, depending on the amplitude of noise 
added. It has further been realized that, by using shape 
from shading theory, one can turn an image into a 
reflective or refractive surface. In effect this technique 

20 is used to model the image intensities as a three- 
dimensional surface. 

A final category of image manipulation that is 
used by the present invention is colour space conversion. 
Most colour video images reside in the RGB (red, green, 

25 blue) colour space, due to the limitation of phosphor 
colours. However, colour image processing is most 
conveniently carried out in the HSI (hue, saturation, 
intensity) colour space where the colour of a pixel may be 
decoupled from its intensity. Thus, a contrast stretch 

30 operation may be performed on the intensity component only 
of an image without effecting the colour balance. 
Consequently, RGB to HSI and HSI to RGB conversions are 
commonly used in operations by the present invention. 
Further, one often requires a hard copy of an image that 

35 has been processed in the video domain. The accomplish 
this, one must convert the RGB video image to the CMYK 
(cyan, magenta, yellow, key) colour space, that 
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corresponds to available inks in the printing industry. 
This IS a non-trivial conversion if high quality results 
are required. 

These effects can be achieved either in a 
5 software form or in real-time hardware. It is believed 
that at the present time there is hardware available that 
would enable circuit cards to be constructed incorporating 
image processing ASICS, to effect the methods of the 
present invention. These circuit cards would be controlled 
10 from various industry standard computer buses. 

Reference will now be made to Figures 1-9 which 
show examples of techniques or methods in accordance with 
the present invention. 

In all these examples, where reference is made 
15 to specific kernel sizes, etc., this is to an image having 
a 512x512 pixel size. 

Figure 1 shows an apparatus for effectively 
imparting a brush stroke texture to an image, the 
apparatus in Figure 1 being generally denoted by the 
20 reference 1. The apparatus 1 includes an input 2 for the 
image, which is the! input to a rank value filter 4. 

The rank value filter 4 is in turn connected to 
a Laplacian filter 6 and then a variable gain unit 8. The 
gain unit 8 has its output connected through an addition 
25 unit 10 to an output 12. Another input of the addition 
unit 10 is taken directly from the output of the rank 
value filter 4 through a bypass line as indicated at 14. 

In use, a kernel or window size and shape is 
selected for the rank value filter 4 and this determines 
30 the brush stroke size and shape. Thus, one can use a 
window that is elongate to achieve a brush stroke in a 
particular: direction. The gain, G, set by the gain unit 8, 
sets the stroke boldness. If 6 is set to zero, the stroke 
will be muted. However as the gain 6 increases, the stroke 
35 prominence Increases. 

By way of example, the rank value filter 4 can 
have a square kernel with each dimension of the kernel 
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varying from 1-15 pixels (with a median rank value). The 
gain unit 8 can provide a gain in the range 0-3. Zero 
gain gives a muted brush stroke, whereas a gain of 3 gives 
a bold brush stroke affect. The size of the kernel affects 
5 the brush stroke size and imparted. A more particularly 
preferred set of parameters would be a kernel size of 7 
pixels square and a gain of 1.5. 

For the rank value filter 4, a variety of kernel 
shapes could be used, for example square, rectangular, 
diagonal, cross and circular, depending upon the type of 
brush stroke required and the direction required for the 
brush stroke. 

The rank value filter 4 removes or smooths 
details from the image that are smaller than the filter 
15 kernel extent, hence it is the kernel size that determines 
the effective brush stroke size. This local smoothing 
action tends to leave an imprint of the size and shape of 
the rank value filter kernel in the ares of the image 
where detail has been removed. If the kernel shape and 
size are chosen such that it is the shape and size of the 
desired brush stroke, the rank value filter output image 
will appear to have muted brush strokes imparted on it, A 
Laplacian filter is often employed to emphasize the image 
detail. Here, the Laplacian filter- is employed to 
25 emphasize the boundaries of the imparted brush strokes, 
and depending upon the gain used, the brush stroke can 
range from muted to bold as the gain is increased. 

Referring now to Figure 2, there is shown an 
apparatus generally indicated by the reference 20 , which 
again has an input 22 and an output 24 which are connected 
through an addition or summation unit 26. The input 22 is 
additionally connected through an edge magnitude detector 
unit 28 and a variable gain unit 30, whose output is 
connected to another input of the addition unit 26. 
35 Here, the gain unit 30 can be adjusted to 

provide either a positive or negative sign to the gain. 
The effect of the units 28, 30 is to add the detected 



20 



30 
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edges to the output image. If a positive sign is set by 
the gain unit 30, then the edges will be outlined in 
white, whereas if the unit 30 provides a negative sign 
then the edges will be outlined in black. The intensity of 
5 the outlining depends upon the gain set by the unit 30. 

By way of example, a preferred arrangement of 
this second apparatus would have an edge magnitude 
detecting unit 28 which is a morphological edge detector 
(as disclosed in J. Serra, "Image Analysis Mathematical 
10 Morphology", Academic Press, New York, 1983). This edge 
detector has a square kernel with each side of the kernel 
having from 1-5 pixels, more preferably 3 pixels. The 
gain unit 30 can have a gain that varies in the range of 
1-5 aAd preferably a gain of 3.5. The size of the kernel 
15 and the edge detector is directly proportional to the edge 
thickness in the pixels • 

Other edge detectors that could equally be used 
as the edge magnitude detector number 28 are the Sobel 
Edge Detector, the Compass Gradient Edge Detector, the 
20 Laplacian Edge Detector, the Roberts Edge Detector, the 
Kirsch Operator, the Difference of Gauss ians Edge 
Detector. It should be noted that a variety of other image 
edge enhancement filters could be used. 

The edge magnitude detector unit 28 creates an 
25 image in which each pixel in image is proportional to the 
magnitude of any intensity changes near that pixel. Thus, 
areas where intensity changes abruptly have a high output 
in the edge detection image, and areas with little change 
in intensity have a low output in the edge detection 
30 image. This method strengthens the edge content of an 
image by adding or subtracting edges that have first been 
multiplied by a variable gain factor to or from the 
original input image. Adding the gain multiplied edges 
tends to make regions of the input image with high edge 
35 content to appear white, while subtracting the gain 
multiplied edges makes those regions appear black. Thus, 
the overall effect of this technique is to make areas in 
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the input image with a high edge content become outlined 
in white or black. 

Referring now to Figure 3, this shows an 
apparatus generally denoted by the reference 32 which 
5 includes an input 34 and an output 36, for the input image 
denoted by P«(x # y) and P 0 (x,y) respectively. The processing 
is indicated within the box 38. This is given by the 
following equation: 

Po(x / y)=P i (x+Gn 1 (x f y) / y + Gn 2 (x,y)), for all x,y 

10 Where: 

n i( x /Y) and n 2 (x,y) are random numbers generated for each 
input image pixel; and G is a constant gain value., 

Effectively, for each pixel given by the 
coordinates x,y, one generates two random numbers n^x f y) 
15 and n 2 (x,y) . Each of these random numbers is multiplied by 
a gain factor G and then added to the respective 
coordinate x or y. Thus, each of the output coordinates 
for x and y is the same as the input coordinate, plus the 
random number multiplied by the preset gain. 
20 The effect of this is to scatter the pixels 

across the image, the degree of displacement of the pixels 
from their original positions being dependent upon the 
gain set. This gives an air brush effect with variable 
coarseness, the degree of coarseness being determined by 
25 the gain set. 

A preferred random numbered generator is one 
which produces random numbers with a uniform probability 
density function in the range from 0 to 1. This is then 
preferably combined with a gain of 2 to give a mild 
30 splattering dislocation of the pixels. A gain of, for 
example, 20 gives a very dislocated and hazy splattering 
of a pixel, while gains of greater than 20 tend to produce 
images that are unrecognizable. 

Other probability density functions from a 
35 random numbered generator may be used with equal success. 
The texture of the dislocated pixels would change as the 
density function changes. For example, a normal 
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probability density function with zero mean and unity 
variance could be used and the result would be a somewhat 
less coarse pixel dislocation for the same gain factor. 
Log-normal exponential, poissbn and other probability 
density functions could also be used to give a good 
effect. 

Turning to Figure 4 , there is shown an apparatus 
for providing a chrome surface effect. Here, the apparatus 
is generally denoted by the reference 40. Again, the 
apparatus is shown as a single unit having an input 42 for 
an image, P ir to be processed and a second input 44 for an 
image, P R , that is to be reflected into the output image. 
An output is indicated at 46. The equations indicating the 
processing occurring in the apparatus 40 are as follows: 



Where x 



P c (x,y) « P R < X T'V for a11 x#y 



x m arctan 



Y T « (y;P i (x,y)-P i (x,y-b) « 0 



y n arcta 



( ■ ) ■ 

-P^x^-h) » 0 

/ b J - 

(P i (x # y)-P i (x,y-b)/ 



otherwise 



otherwise 



Where: a, b are constants setting the surface smoothness, 
and where x. and y. represent the maximum extent of the 
digitized input images in the x and y directions 
re spec t i ve ly • 

In effect, the process here is reflecting the 
image, P R , in the input image, P i# and thus is treating the 
input image as a reflective or mirrored surface. Further, 
the intensity of each pixel in the input image, P i is 
treated as the height above an arbitrary flat surface, so 
as to yive a three dimensional effect, two dimensions 
being the x and y coordinates and the third dimension 
being the pixel intensity. 
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Thus the method starts by converting the input 
image, P { , into a three dimensional surface. It then 
assumes that this is reflective and effectively takes the 
reflection of the- image, P R/ in- this reflective surface. In 
5 order to be able to "see" the shape of a complex 
reflective surface, one has to have some image that is 
reflected in it. It is for this reason that the image P R is 
provided. The image P„ can be any suitable image, and can 
be selected to give a desired appearance. 
10 rt should be appreciated that if the input 

image, P, is simply a flat surface, i.e. a conventional 
plain mirror, then one would obtain a pure reflection of 
the image to be reflected, p R . where the input image P, is 
a complex shape, e.g. a person's head, then the reflective 
15 surface is extremely complex and, resulting in 
considerable distortion of the image to be reflected, P„, 
so that this is often unrecognizable. Even if the 
reflected image P R becomes totally distorted and 
unrecognizable the output image still retains the shape or 
appearance of the input image P^ but with a simulated, 
reflective or chrome finish. 

The equations given above effectively intend to 
simulate, in a simplistic way, this process. These are 
discussed below for the x coordinate, it being appreciated 
25 that the y coordinate is calculated in an exactly 
corresponding manner. 

For the x coordinate when the condition P, (x,y) 
minus P, (x-a,y) = 0, one has a flat reflective surface, at 
least locally. Hence, a point on the image to be 
30 reflected, P R is reflected back from the flat surface to 
exactly the same point. For this reason, X t is simply set 
equal to x. However, where this condition is not met, i.e. 
the surface is not locally flat, consequently, the local 
surface of the image P 1 will point to an alternate location 
35 on the image to be reflected P R . The arctan function is 
simply a calculation as to the point in the image P R that 
the locally inclined surface of the image P, indicates. 



20 
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It is appreciated that these calculations are 
optically simplistic/ and do not take into account the 
complex effects one obtains from complex curved surfaces . 
Nonetheless, it has been found that the overall effect is 
5 to give a very effective simulation of a chrome surface, 
which prpduces a realistic three-dimensional effect, 
representive of the original input image P^. The input 
image P 1 then appears to have been coated with reflective 
or chrome finish. 

10 Whilst a variety of different constants can be 

used, it has been found that a useful range for the 
smoothing constants a,b is 1-15, with a value of 1 
creating a reflective surface that is most sensitive to 
the undulating surfaced of P i and the value of 15 being 

15 much less sensitive than the local variations in P i * 

As an example of the image that can be used for 
the image to be reflected, P R , one can choose a ramp image 
represented by the formula P R (x,y) - y for all x,y. This is 
a ramp which increases from zero at y = 0 to a maximum 

20 value for the maximum value y. It will be appreciated that 
the ramp can be arranged to incline in any direction • In 
effect, the intensity of the image to be reflected, P R , 
varies as the shape given by the ramp. 

The result of using such an image for the image 

25 to be reflected, P R , is to give a 3-0 bas relief effect of 
the input image, P R . This results because when P R is chosen 
as a uniformly changing ramp image, it varies from dark to 
light across its surface. This models a uniformly changing 
light source that is reflected into the reflective surface 

30 of the input image P i# which tends to light the three 
dimensional surface model of the input image in a way that 
gives it a three dimensional relief image. In other words, 
the lighting gives depth as seen by a viewer. 

Referring now to Figure 5, there is shown a 
35 fifth apparatus generally denoted by the reference 50. The 
apparatus 50 has an input 52 for an input image which is 
divided into two branches, one branch 53 connected 
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directly to a combination unit 58 and another branch 54 
connected to a contrast stretch unit 56. The output of the 
contrast stretch unit 56 is also connected to an input of 
the combination unit '58. The combination unit 58 has an 
output 59. 

The unit 56 performs a contrast stretch 
operation which is given by the following equation: 



P 2 " 



<x,y)0* P^x^J^lNTENSITY 2 

MAX-VAL; ? x ( x, y )>INTENSITY x 

MAX-VAL (Pj^fx^yJ-INTENSITYj) ; 



otherwise 



INTENSITY^ - INTENSITY. 



for all x,y. 



10 and MAX-VAL is the maximum allowable pixel value in the 
input image; INTENSITY, , INTENSITY 2 are selected image grey 
levels with INTENSITY, INTENSITY 2 . 

The function given by the above equation 
essentially sets the output, P 2 (x,y), by three separate 

15 calculations, depending upon the value of the input 
signal, P,(x,y) . If p, is less than INTENSITY 2 , then the 
output P 2 is set to zero. If P, is between INTENSITY 2 and 
INTENSITY,, then P 2 is determined by the equation above 
which essentially gives a straight line slope from zero to 

20 . the maximum value as P, increases from INTENSITY 2 to 
INTENSITY, . Where P, is greater than INTENSITY,, then the 
output is set to the maximum value. 

The effect of this is to stretch a middle range 
of grey levels, and eliminate the upper and lower grey 

25 levels from the input signal by setting them to zero or 
the maximum value respectively, if one considered a 
histogram of the distribution of the pixel intensities 
against the grey level or intensity, one would find that 
the middle portion of the histogram had effectively been 
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outer portions of the original histogram had effectively 
moved to the very edges . 

The combining function performed by the 
5 combination unit 58 dan be given by either one of the 
following equations i 

P 3 (x,y) - P 1 (x,y) + P 2 ( X/ y) ; for all x,y 

or 

P 3 (x,y) » Pj^Cx^y) + P 2 (x # y) ; for all x,y 

10 2 

The first of these equations is a simple 
summation, and will effectively give an increase in the 
overall intensity. The second of these equations 
represents an averaging effect. 

15 The overall effect of this technique is to add 

highlights to an image. The values selected for INTENSITY) 
and INTENSITY^ set the highlight brightness and extent. 

An alternative way of considering Figure 5 would 
be to provide two variable gain units in the two branches, 

20 and then a simple summation unit at 58. If the gains of 
the two units are set equal to one another and some 
arbitrary constant, then the two branches are effectively 
added, as well as being multiplied by the arbitrary 
constant \ If the two gains are set equal and equal to one- 

25 half , then one effectively obtains an average of the two 
branches. Thus, by providing two gain units one obtains a 
more general combination of the original image and the 
contrast stretched image. 

With regard to preferred operating parameters 

30 for this Figure 5 embodiment, for a well exposed video 
resolution image, INTENSITY; and INTENSITY, could be chosen 
as the sixtieth percentile grey level in the input image 
and the ninety-fifth percentile grey level in the input 
image respectively. This percentile selection adds 

3 5 robustness to a varying lighting condition. This 
effectively adds or averages the pixel intensities between 
the sixtieth and ninety-fifth intensity percentiles to the 
input image. This range of intensities between these two 
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percentiles is deemed to be the highlights of the input 
image . 

If the highlights are averaged with the input 
image, the highlights • are incorporated into the image in 
5 the locations that they are present in the original input 
image; however, in areas of image where there are no 
highlights present, the addition of highlights has no 
affect. Where the averaging technique is used, the areas 
with highlights are still highlighted, but to a slightly 
lesser extent, whereas the areas with no highlights are 
effectively decreased in intensity. This has the effect of 
making the highlights more pronounced. Averaging the 
highlights into the image makes the output image appear as 
if the highlights were added using chalk. 
15 Referring to Figure 6, there is shown an 

apparatus, intended to transform an input image into a 
line drawing. The apparatus, here denoted 60, has an input 
62 connected to first and second mean filters 63, 64. The 
output of the mean filters are connected to positive and 
20 negative inputs of a summation unit 66, which has an 
output 68 forming the output of the apparatus. Here, the 
first mean filter 63 has a kernel m x n, whilst the second 
mean filter has a kernel u x v. The kernel of the first 
mean filter 63 is greater than that of the second mean 
25 filter 64; in other words, m is greater than u and n is 
greater than v. 

The output at 68 is given by the following 



35 



equation : 



J!»/2 n/2 



" PMx-i,y-j) 
i^-m/2 l~-n/? 



mn 




* for all x, : 
uv 
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The effect of this arrangement is, for each 
pixel, to first take a mean within a first kernel of all 
the pixels in that kernel, and then subtract a mean signal 
derived from the second, smaller kernel, to arrive at an 
5 output signal . 

Each mean filter 63, 64, performs a low-pass 
function. The cut-off frequency of each mean filter is 
determined by the size of the kernel, so that the filter 
with a smaller kernel has a higher cut off frequency. By 

10 subtracting the output of one filter from the other, one 
obtains a band-pass filter. Normally, edge information 
occupies the higher frequency regions of an image, i.e. 
sharp transitions. However, image noise also tends to 
reside at the higher frequencies. Thus, if one uses a 

15 band-pass filter, one can pass some of the high 
frequencies through to extract the image edges for forming 
a line drawing, but simultaneously attenuate the highest 
frequencies that contain noise and make for a dirtier or 
noisier line drawing image. 

20 ' Here, it will be appreciated that, because of 

the relative sizes of the two kernels, one is in fact 
subtracting the output from the mean filter with the 
highier cut-off frequency, namely filter 64 from the output 
of the other mean filter with the lower cut-off frequency, 

25 namely, filter 63. In effect, this gives a negative band 
pass filter operation. 

The result is that the small features in an 
image, normally associated with higher frequencies, such 
as a human tooth or iris of the pupil are outlined; a 

30 conventional band-pass filter would cause them to appear 
to be filled in. Here, it is to be noted that if the 
negative band-pass filter gives an output indicating a 
negative value for the intensity then this is treated as 
zero. 

35 It has been found that useful ranges for the 

sizes of the two kernels are the range 1-13 for the 
parameters u, v and the range 3-15 for the parameters m, 
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n. The* more 'particularly preferred values are for u and v 
to be both equal to 7 and m and n to be both equal to 11. 

Figure 7 shows an apparatus for modifying an 
image so that it appears to be painted in a water colour 
5 style. In particular, rounded blobby features reminiscent 
of, or simulating, paint dabs are added to the image. 

The apparatus 70 of Figure 7 has an input 72 
connected to an input of a first rank value filter 74, 
which in turn has an output connected to a second rank 
10 value filter 76. 

The output of the second rank value filter 76 is 
connected, as in the first arrangement of Figure 1, 
through a Laplacian unit 78 and a gain unit 80 to a 
summation unit 82. There is also a bypass line 84 
15 providing a direct connection from the output of the 
filter 76 to the summation unit 82. The summation unit 82 
sums its two inputs and forms an output 86. 

The two rank value filters 74, 76 have identical 
kernel size and shape, but the rank value for each filter 
20 is chosen differently, in accordance with the following 
method • 

Let a rank value of 1 with respect to a kernel 
correspond to the minimum pixel value in the kernel and a 
rank value of N correspond to the maximum pixel values in 
25 the kernel. Choose a value of p such that: 1 ^ ^ 

Then the rank for the filters 74, 76 are 
selected as: 

RVF Filter 74: p 
30 RVF Filter 76: (N + 1) - p 

Thus in effect, p is chosen arbitrarily and the 
sum of the two ranks for the two rank value filters is 
equal to the sum of the maximum and minimum rank value in 
the kernel. When p is halfway between one and N, then the 
35 rank for each filter will be similar. The bright areas of 
the image do not then move relative to the dark areas of 
the image. However, as p is decreased toward one, then the 
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first rank value filter will have the low rank p, whilst 
the second rank value filter 76 will have a relatively 
high rank. This has the effect of- the dark areas of the 
image expanding more into the light regions . 
5 Correspondingly, as p is increased towards N, the light 
regions of the image expand more into the dark regions. 

The combination of the two rank value filters 
produces the rounded blobby areas. The units 78-84 
accentuates the paint dabs. A low gain, e.g. close to 
zero, produces a muted blob, whilst a higher gain produces 
a stronger dab. It is to be noted that components 78-84 
correspond to the arrangement shown in Figure 1. 

It is to be noted that if p = 1, then the first 
rank value filter 74 is a local minimum filter or 
15 morphological erosion operator, i.e. it causes bright 
areas of the image to contract and dark areas to expand, 
and the second rank value filter 76 is then a local 
maximum filter or dilation operator, i.e. bright areas of 
the image expand while dark areas contract. The 
20 combination of the two filters operating as erosion and 
dilation operators performs an operation referred to as a 
morphological opening. The net effect of an opening is 
that local peaks in the image smaller than the kernel 
extent are smoothed from the image and the dark areas of 
25 the image seep into the bright areas, since the dilation 
does not quite counter-act the initial erosion. The 
combination of this local peak smoothing and dark regions 
swelling produces round blobby areas in the image 
reminiscent of water colour paint dabs. 
30 Correspondingly, if p - n, the roles of the two 

rank value filters are reversed. The first rank value 
filter 74 becomes a maximum filter, whilst the second rank 
value filter 76 becomes a local minimum filter. The 
combination of the two filters working in series then 
35 performs a morphological closing. The net effect of such 
a closing is the local valleys in the image, i.e. dark 
areas which are smaller than the kernel extent, are filled 
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in and the bright areas of the image seep into the dark 
areas. Here, the erosion does not quite counteract the 
initial dilation. Again, in the combination of valley 
filling and light region swelling produces blobby areas 
5 reminiscent of water colour dabs. 

If p is adjusted to be in the mid-point between 
1 and N, there is less movement of the dark regions into 
the light and vice versa. As well, the overall effect of 
the blob area creation diminishes as p approaches the mid- 
point, since full erosions and dilations are no longer 
being performed. The two rank value filters become median 
filters that preserve intensity boundary locations, thus, 
when p is located in the mid-point of the range, the water 
colour effect becomes more subtle. 
15 The role of the Laplacian filter 78 and gain 

unit 80 is to strengthen the paint dab boundaries. The 
higher the gain the more pronounced the boundary. 

The preferred parameters for this method are: 
p - 20 

20 N = 25 

G - 1.0 

However, useful ranges for these parameters are: 
1 £a p £ N/5 

or (N-N/5) * p *» N 

25 N in the range 9-121 

G in the range 0-3 

Turning to Figure 8, there is shown a method and 
apparatus for combining different effects together. Here, 
the apparatus 70 has an input 72 connected to first and 
30 second processes indicated at 74, 76 and to a conditioning 
unit 78. The outputs of these three units 74, 76 and 78 
are connected to an image composition unit 80 which 
produces an output 82. 

The processes 74, 76 can be any one of the 
35 processes in accordance with the present invention, e.g. 
those described in relation to the preceding figures. This 
apparatus enables them to be combined in a variety of 
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ways, Ttio conditioning unit 78 provides a switching 
function to combine the two modified images produced from 
the processes 74, 76 as desired. 

The conditioning unit 78 can produce the 
5 following function at the output 82: 

bc«.r> - "- t"'-"' * ( r»! at - r "" Y " B "" Y ' 



Where: 



MAX VAL 

MAX VAL is the maximum allowable pixel intensity 

value* : 

10 in effect, this function provides that the 

respective weights given to the two processes A, B, 
depends upon the intensity of the conditioning signal, C, 
for that particular pixel. 

It is expected that useful conditioning 

15 functions for the conditioning unit 78 are: no 
conditioning performed; edge magnitude detection; and 
contrast stretching. Other conditioning techniques are 
possible. Thus, one can detect different areas of an image 
in relation to colour and/or intensity or other factors. 

20 Then, these different areas can be subjected to different 
processes. Also, whilst just two processes 74, 76 are 
shown, it will be realized that this basic arrangement can 
be generalized to any number of processes. 

Another possibility is to combine images 

25 dependent upon the brightness, i.e. in the bright areas 
one processing technique is used, whereas in the dark 
areas another technique is used. In this case, the input 
image itself may serve as the switching function. However, 
one may .wish to condition the input image in some way to 

30 change the reaction of the switching function. For 
instance, an edge magnitude detector could be employed to 
create image C. This has the effect of having image A 
dominate the output image and areas of high edge intensity 
and image B in regions of low edge intensity. 

35 Alternatively, the input image could have its intensity 
profile modified in some way such as a contrast stretch in 
order to modify the switching function. 
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Referring now to Figure 9, there is shown an 
example of one conditioning process that could be used. 
Here, the conditioning unit 98 has an input 104 which is 
connected to the input's of a rank value filter 106 and a 
5 mean filter 108. The outputs of these two filters 106, 108 
are connected to a combination unit 110 which has positive 
and negative inputs for the two filters, 106, 108 
respectively. The output of the unit 110 is connected to 
the threshold unit 112, and in turn to an output 114. 
10 T he rank value filter 106 has a rank value of 

25, i.e. a median value. The thresholding unit 112 
provides thresholding process where every pixel intensity 
greater than the threshold t is mapped to MAX VAL. Any 
pixel having an intensity less than t is mapped to zero. 
15 Here, t is set equal to 1. 

With this conditioning process, the output of 
114 will be set equal to MAX VAL, where the local median 
value is greater than or equal to the local mean value. On 
the other hand, where the median value is less than the 
20 mean value, the output 114 will be zero. . 

Using the equation for the output D(x,y), for 
Figure 8, then the output will be process 1, where the 
local median value is greater than or equal to the local 
mean value. On the other hand, where the median value is 
25 less than the mean value, then process 2 will be passed 
through to the output. 

The effect of this switching function is to 
produce a strong painted effect. 

The two filters 106, 108 preferably have a 
30 kernel size of 7 x 7. 

Reference will now be made to Figure 10, which 
shows a block diagram for a real-time digital video effect 
process, indicated by the reference 120. The process of 
120 has an analog to digital converter 122 with an input 
35 for a video signal. This produces two outputs, 123, 124 
for the RGB and HSI colour spaces. 



SUBSTITUTE SHEET 



WO 91/02425 PCT/CA90/00246 

. r : - 26 - . 

A switch 126 enables either or both of these 
outputs 123, 124 to be connected through to two separate 
branches 128 and 130. 

In the first branch 128 , there is an rank value 
5 filter 132, connected to a convolution filter 134/ and 
then in turn to a lookup table 136. 

In the second branch 130/ there is an edge 
detection unit 138/ another lookup table 140 and an 
arithmetic logic unit 142, 
10 Ais indicated at 144 the various components 132- 

142 would be mounted in a common housing and connected, as 
indicated by terminals 146, to one or more digital 
crosspoint switches. These digital crosspoint switches 
would enable the components 132-142 to be connected in a 
15 variety of patterns. The input switch 126 and output 148 
cure similarly provided with terminals 146 to enable them 
to be connected by the digital crosspoint switches. 

In Figure 10, arrows 150 indicate, 
schematically, the digital crosspoint switch or switches 
20 and their effective connections. 

Thus, here the input signal passes through the 
first branch 128 where the signal is given a brush stroke 
effect by the rank value filter 132 and then sharpened in 
the convolution filter 138 prior to a contrast stretch 
25 operation by the lookup table 136. Simultaneously, in the 
other branch, the convolution filter 138 detects edges, 
and the magnitude of the edges and then normalized by the 
lookup table 140. 

The arithmetical logic unit 142 subtracts the 
30 output of the two lookup tables 136, 140, so as to 
subtract the normalized edges from the image from the 
first branch 128. The edges in the resulting image will 
now have dark outline highlights. 

The output 148 is then connected by a switch 152 
35 to the RGB or HSI input of a digital to analog converter 
154, and then to a final output 156. 
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We cliimi ' 

An apparatus, for transforming a digitized 
signal of an image to give a brush stroke effect, the 
apparatus comprising: ■ a main input; a first rank value 
5 filter having an input for an original digitized signal, 
connected to the main input of the apparatus; a Laplacian 
unit having an input connected to an output of the rank 
value filter and an output; a gain unit with variable gain 
and connected to the output of the Laplacian unit; a 
summation unit having one input connected to an output of 
the gain unit and an output forming an output of the 
apparatus; and a bypass line connected between the output 
of the first rank value filter and another input of the 
summation unit, 

15 2 • An apparatus for strengthening the edge content 

of a digitized signal of an image, the apparatus 
comprising: a main input for the digitized video signal; 
an edge magnitude detector connected to that main input; 
a gain unit having an input connected to an output of the 
20 edge magnitude detector unit and an output; and a 
summation unit having an input connected to the output of 
the gain unit and an input connected to the main input, 
and an output for a transformed digitized signal, whereby 
the gain unit can be adjusted to adjust the amount of the 
25 image edges detected by the edge magnitude detector unit 
which are combined with the original image. 
3 * An apparatus for adding an airbrush effect to a 

digitized signal of an image, the apparatus comprising: 
means for generating, for each pixel, first and second 
30 random numbers corresponding to the first and second 
coordinates for that pixel, and summation means for 
adding, for each pixel, the two corresponding random 
numbers to the two corresponding coordinates respectively, 
to produce output coordinates, whereby the pixels of the 
35 original image are scattered randomly in the output image 
in dependence upon the random numbers generated. 
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4. An apparatus as claimed in claim 3, which 
additionally includes means for generating a constant 
gain, which can be varied by a user, and means for 
multiplying the random numbers for each pixel by the gain 

5 value from the constant gain means, whereby adjustment of 
the gatp value enables the degree of scattering of the 
pixels to be varied* 

5. An apparatus, for transforming an input 
digitized signal of an image comprising a plurality of 

10 pixels to give the appearance of a reflective chrome 
surface, the apparatus comprising: an input for an 
original digitized signal of an input image; an input for 
a reflected digitized signal of an image to be reflected 
in the input image; means for generating smoothness 

15 constants for the two coordinates of the pixels 
representative of the surface smoothness; means for 
generating image extent constants representative of the 
image extent of the pixels in the two coordinate 
directions ; means for checking, for each coordinate of 

20 each pixel, whether a first intensity, being the intensity 
of the respective pixel of the input image, is the same as 
the second intensity of another pixel of the input image 
spaced along the respective coordinate by the respective 
coordinate smoothness constant; setting means for setting, 

25 for each coordinate of each pixel, the respective 
coordinate equal to the coordinate of the input image when 
said checking means determines that the first and second 
intensities are the same, and otherwise, for setting the 
coordinate equal to the coordinate image extent constant 

30 divided by n and multiplied by the arc tangent of the 
respective coordinate smoothness constant divided by the 
difference between the first intensity minus the second 
Intensity; and means for determining, for each pixel, the 
intensity in a transformed output image by taking the 

35 intensity of a corresponding pixel in the reflected 
digitized signal determined by the coordinates set by said 
setting means . 
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6 * An apparatus, for adding highlights to a 

digitized signal of an image , the apparatus comprising a 
main input connected to a contrast stretch unit, in which 
first and second intensities can be set by the user and in 
5 which the intensity for each pixel is set equal to zero if 
the input intensity is less than the second intensity, is 
set equal to the maximum value of the intensity in the 
input image, if the input intensity is greater than the 
first intensity, and otherwise is determined by 
10 multiplying the maximum value of the intensity in the 
original input image by the difference between the input 
intensity of that pixel and the second intensity, and 
dividing by the difference between the first and second 
intensities, the first intensity being greater than the 
15 second intensity; and a combination unit which has an 
input connected to the main input and another input 
connected to an output of the contrast stretch unit, 
whereby the contrast stretched image is combined with the 
original image to give an output at an output of the 
20 combination unit, 

7 * An apparatus as claimed in claim 6, wherein the 

combination unit, for each pixel, after summing the two 
units, divides the resultant value by two to obtain an 
average intensity from the two input signals, which forms 
25 the output. 

8. An apparatus for transforming a digitized signal 

of an image to resemble a line drawing, the apparatus 
comprising a main input; a first mean filter connected to 
the main input and having an output and defining a first 

30 kernel; and a second mean filter having an input connected 
to the main input and an output and defining a second 
kernel, the second kernel having dimensions in both 
coordinate directions less than the dimensions of the 
first kernel; and a summation unit for forming, for each 

35 pixel, the difference between the mean value determined by 
the first mean filter and the mean value determined by the 
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second moan filter, and having an output forming the 
output of the apparatus . 

9. An apparatus as claimed in claim 8, wherein, the 
summation unit subtracts the output of the second filter 

5 from the first filter. 

10. An apparatus an claimed in claim 1, which is 
adapted for imparting a water colour effect to the 
digitized signal, and which further comprises: a second 
rank value filter having an input connected to the main 

10 input of the apparatus and an output which is connected to 
the input of the first rank value filter, and wherein the 
rank value filters have kernels of the same size and 
shape, wherein the rank of the first rank value filter is 
chosen to lie between the maximum and minimum value of the 

15 pixels in the kernel, and wherein the rank of the second 
rank value filter unit is set equal to the sum of the 
minimum and maximum pixel values in the kernel, minus the 
rank of the first rank value filter, whereby adjustment of 
the rank of the first rank value filter and hence of the 

20 rank of the second rank value filter varies the relative 
sizes of the bright and dark areas in the image. 

11. An apparatus for incorporating two or more 
effects into a digitized signal of an image, the apparatus 
comprising two or more apparatus as claimed in claims 1, 

25 2, 3, 5, 6, 8 and 10; a conditioning unit for generating 
a conditioning signal and having an input, the input 
digitized signal being connected to the input of the 
conditioning unit and the inputs of the selected 
apparatuses; and an image composition unit having inputs 

30 connected to the outputs of the selected apparatus and an 
output of the conditioning unit, the image composition 
unit composing an output image by selective combination of 
the outputs of the selected apparatuses as determined by 
the conditioning signal. 

35 12. A method of transforming a digitized signal of 

an imagre to give a brush stroke effect, the method 
comprising, in the following order, the following steps: 
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(i) passing the signal through a rank value 
filter to filter the intensities of the pixels, to produce 
a rank value filtered signal; 

(ii) passing the signal through a Laplacian unit 
5 and subsequently applying a preset gain to the signal; and 

(iii) adding the rank value filtered signal from 
step (i) to the signal produced by step (ii) to produce an 
output signal. 

13 • A method for strengthening the edge content of 

a digitized signal of an image, the method comprising, in 
the following order, the following steps; 

(i) detecting edges of the signal to produce an 
edge signal having an intensity indicative of the edges in 
the original image; 

15 (i 1 ) multiplying the edge signal by a pre-set 

gain; and 

(iii) adding the gain multiplied edge signal of 
step (ii) to the original signal to produce an output 
signal. 

20 14 • A method of adding an airbrush effect to a 

digitized signal of an image, the method comprising, in 
the following order, the following steps: 

(i) for each pixel generating first and second 
random numbers corresponding to the first and second 

25 coordinates for that pixel; 

(ii) for each coordinate of each pixel, adding 
the respective random number to that coordinate to produce 
an output coordinate, whereby the pixels of the original 
image are scattered randomly in an output image in 
dependence upon the random numbers generated. 

15 • A method as claimed in claim 14, wherein step 
(i) includes the additional step of multiplying each 
random number by a preset gain, whereby varying the gain 
varies the degree of scattering of the pixels in the 

35 image. 

16 • A method for transforming an input digitized 
signal of an input image to give the appearance of a 
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reflective chrome surface, the method comprising, in the 
following order, the following steps: 

(i) generating smoothness constants for the two 
coordinates of each pixel representative of the surface 

5 smoothness ; 

(ii) generating image extent constants 
representative of the image extent of the pixels in the 
two cbordinate directions; 

(iii) providing a reflected digitized signal of 
10 an image to be reflected in the surface of the input 

image; 

(iv) for each coordinate of each pixel, checking 
whether a first intensity, which is the intensity of the 
respective pixel in the input image, is the same as the 

15 second intensity of another pixel of the input image 
spaced along the respective coordinate by the respective 
coordinate smoothness constant; 

(v) for each coordinate of each pixel, setting 
the coordinate equal to the coordinate of the input image 

20 when step (iv) determines that the first and second 
intensities are the same, and otherwise setting the 
coordinate of each pixel equal to the respective 
coordinate image extent constant divided by it and 
multiplied by the arc tangent of the respective coordinate 

25 smoothness constant divided by the difference between the 
first intensity minus the second intensity, 

(vi) determining, for each pixel, the intensity 
in a trans formed output image by taking the intensity of 
a corresponding pixel in the reflected digitized signal 

30 determined by the coordinates calculated in steps (iv) and 
(v) . , 

17. A method for adding highlights to a digitized 

signal of an image, the method comprising, in the 
following order, the following steps i 
35 (i) setting first and second intensities, the 

first intensity being greater than the second intensity, 
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and both the first and second intensities being less than 
the maximum of the intensity in the input image; 

(ii) for each pixel, setting the intensity of 
the pixel equal to zero if the input intensity is less 

5 than the first intensity, setting the intensity in the 
original input image if the input intensity is greater 
than the first intensity, and otherwise multiplying the 
maximum value of the intensity of the original input image 
by the difference between the input intensity of that 
10 pixel and the second intensity and dividing by the 
difference between the first and second intensities, to 
obtain a contrast stretched digitized signal; and 

(iii) adding the contrast stretched digitized 
signal to the original signal to produce an output signal. 

15 18 • A method as claimed in claim 17, wherein, after 

adding the contrast stretched signal to the original 
signal, the sum of those two signals is divided by two to 
produce the output signal. 

19 • A method for transforming a digitized signal of 

20 an image to resemble a line drawing, the method 
comprising, in the following order, the steps of: 

(i) filtering an input signal through a first 
mean filter having a first kernel size; 

(ii) filtering the input signal through a second 
25 mean filter having a second kernel size, the second kernel 

size having dimensions, in both coordinate directions, 
less than the dimensions of the first kernel; and 

(iii) for each pixel, subtracting the output of 
the second filter from the output of the first filter to 

30 determine an output intensity for that pixel. 

20 • A method as claimed in claim 12, which is 

adapted for imparting a water colour effect to the signal, 
and which further comprises the steps of: 

(i) between steps (i) and (ii) filtering the 

35 video signal through a second rank value filter having a 
kernel of the same size and shape as the rank value 
filtering of step (i), wherein the rank of the rank value 
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of step (1) is chosen to lie between the maximum and 
minimum values of the pixels in the kernel , and wherein 
the rank of the second rank value filter is set equal to 
the sum of the -minimum and maximum pixel values in the 
5 kernel, minus the rank of the first rank value filter, 
whereby adjustment of the rank of the first rank value 
filter and hence the rank of the second rank value filter 
varies the relative sizes of the bright and dark areas in 
the image. 

10 21. A method for incorporating two or more effects 

into a digitized signal, the method comprising selecting 
two or more methods from the methods as claimed in claim 
12, 13, 14, 16, 17/ 19 and 20 , and carrying out the 
following additional steps i 

15 (i) generating a conditioning signal from the 

input signal; 

(ii) composing an output signal by selection 
from the outputs of the selected methods, in dependence 
upon the conditioning signal. 
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